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ABSTRACT 



This report discusses the types and results of tests 
used on 142 "reasonably representative" American Indian bilingual 
students at the Institute of American Indian Arts in Santa Fe, New 
Mexico. Major hypotheses of the study were that (1) there is a factor 
in the abilities of an English-as-a-second-language speaker which can 
be isolated as English langauge ability; (2) a low TOEFL (Test of 
English as a Foreign Language) score will occur with poor adjustment 
scores; and (3) there will be a significant difference in the mean 
scores of the two intelligence tests used (the Otis Gamma Verbal and 
the Chicago Nonverbal) . Results seem to warrant two conclusions: (1) 

the TOEFL is a valid measure of English language skill of American 
Indian students; results are close enough to those of the non-native 
speakers of English for whom the test was written to suggest strongly 
that similar abilities are being measured; and (2) since the TOEFL 
and ITED (Iowa ^est of Education Development) do not factor out into 
different factors, ITED also measures language ability. ITED may be 
too hard for the students, however. It is recommended that American 
Indian students be given the same consideration as foreign students, 
with intensive or semi-intensive instruction in English as need, and 
adjustment of course load if indicated. (AMM) 
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IHE RELATION OF A TEST OF ENGLISH AS A SECOND LANGUAGE 
TO MEASURES OF INTELLIGENCE, ACHIEVEMENT, AND ADJUSTMENT 
IN A SAMPLE OF AMERICAN INDIAN STUDENTS 

by 

Annabelle R# Scoon 
and 

Joseph D» Blanchard 

The Problem 

The major problems ' that face all who deal with the education of 
American Indian children are their low level of achievement in academic 
studies and the small number who qualify for higher education, A study 
by Coombs in 1958 found that on standardized tests Indians fell well 
below national norms, and the higher the grade level they reached, the 

farther behind they were. Eight years later, the Coleman study found 

* 

that Indian reading and verbal ability scores in the twelfth grade showed 
a mean more than three grade levels behind the average metropolitan white 
student (Coleman 1966 , p. 270). 

Verbal ability is not the only handicap the Indian student faces. 

The Coleman report found that two measures of attitude— self-concept and 

t 

sense of control over the environment— correlated more closely with school 
achievement than any other variables in the learning situation (Coleman 
19 66 , pp. 319-24). Self-concept was the more important of the two for 
white students, while among Indians a sense of control over the environment 
proved to be the major factor. 

A feeling of lack of control over the environment— a lack of western 
tendency to attack unfamiliar situations directly and overcome them by 
force— are culture traits of Indian societies (Zintz 19^9 • PP* 18-19)* 

This cultural predisposition of the Indian student is combined with the 
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requirement to carry on all school work in English, a language that he 
may not learn until he enters school. Severe retardation in reading and 
verbal ability apparently often occur. 

Reading problems are reliably related to personality problems— 
studies quoted by Park and Linden show that the best differentiating 
factor between poor readers and good readers is personal adjustment. 

They also state that 11 illiteracy and/or foreign language in the home 
and insufficient background were characteristic of reading failures 1 * 

(Park and Linden 1968, p. 326), 

The ability of the Indian to take his rightful place jin the larger 
society of the United States depends to a great extent upon the develop- 
ment of Indian leaders. In a modern technological society, college educa- 
tion is almost a prerequisite for leadership in many fields. Yet Indians 
are not going to college in sufficient numbers. In New Mexico, only 10# 
of Indians complete highschool, compared with 27# of the general popula- 
tion (which includes Mexican-American bilinguals). (Smith 1968, p, 11), 
More than J.uoikar 

/thirty percent of students who entei/ highschool drop out between the 
eighth and twelfth grades (SWCEL 1969, p 7 ). Fewer than 1# of Indians 

graduate from a four-year college (Smith, loc. cit.)i 

We thus have a two-fold problem* first, to find ways to identify 
with reasonable accuracy those Indian students who might succeed in 
college, so that the sorely needed Indian educational leaders will be 
developed. And second „ to find data that will help us determine the major 
sources of Indian students* achievement failures, so that we can design 
learning situations that will carry with them a great chance of success 
for the Indian student. 




3 



The Theory 

The theoretical foundation upon which this investigation is based 
is that second-language learning is different in essential ways from 
learning that takes place in one's primary language, whether before 
school age or during school; and that realistic educational intervention 
requires an understanding of the difference and of the effect it may 
have on all facets of the students' lives# Among the needs that this 
difference creates is the need to be able to test reliably the second- 
language component of the student 8 s knowledge, separate from general 
academic achievement, and to discover how language achievement is related 
to personal adjustment. 

The language learned in childhood is the major means through which 
the growing mind orders its processes of cognition and affection. In 
the words of Edward Sapir, "The fact of the matter is that the 'real world* 

is to a large extent unconsciously built up on the language habits of 

, . * f t 

the group. ...We see and hear and otherwise experience very largely a& 

* \ 

we do because the language b«bits of our community predispose certain 
choices of interpretation. ...No two languages are ever sufficiently 
similar to be considered as representing the same social reality" (Sapir 

f • 

1961, p. 69 ). The "thing" world may be the same for us all, but it is 
organized in consciousness in terms of the categories and relations that 
a specific language provides (Whorf 1956, pp. 239-45). 

Learning a second language involves learning new sounds, grammatioal- 
morphological patterns, word meanings, and a new underlying world-view or 
way of ordering data given by experience to consciousness. All of these 
Must be added to or substituted for an existing system, the first language. 

ERIC 
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They are not learned in direct response to developing consciousness of 
the world , as the first language is. They are not learned from the all- 
important Significant Others— parents or parent- surrogates— but from strange, 
often feared adults of a different cultural world. The learning situation 
itself may create tensions leading to failure, especially if the learner 
is deprived of the support of his primary social group. School is still 
an extremely threatening place to many Indian children ( Styles of Learning 

1968, p. 1). 

The speed and efficiency of second-language learning depends not only 
on the feeling of the learner toward his new experience, but to some extent 
on the similarity between the two languages. We would expect that learners 
of English as a second language will succeed to a different degree depending 
on their native language. Indian students are bilinguals whose first 
language is very different from English in almost every dimension. Whorf, 
in his article M Languages and Logic* 1 (19 5^, pp. 233-3 45) gives numerous 
examples of the extreme differences between English and Indian ways of * 
organizing thought in language terms. 

Testing the Second Language 

The Test of English as a Foreign Language (TOEFL) was put into use 
in 1964 to help colleges choose and place students from abroad. Some of 
these students speak Indo-European languages, but many come from language 
backgrounds as different from English as Indian languages. If the test 
is valid for these students, and colleges have found it generally useful, 
it should also be a valid measure of the English ability of Indian students 
for the same purpose. 
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It is difficult to determine the effect of language competence on 
other facets of the student *s development. However, our theory that the 
primary language is the individual »s most important link with the world 
of Others must lead to the expectation that any change of language would 
have an effect on the total personality. 

Measures of personality are less objective than mea sures of language 
and academic achievement. Nevertheless, if correlation exists between 
such measures, it can be considered at least indicative of a relation 
between adjustment and achievement. 

If standardized tests and intelligence tests are taken at face value 
for Indians, the Indian is stereotyped as a second-class learner. The 
‘•crossover 11 that takes place at about the third or fourth grade, when 
Indian childrens achievement starts downhill in isolation to their white 
classmates is, if the theory of this study is correct, partly the result 
of inadequate learning of English and partly the result of the strain 
that the shift to English creates on the developing personality. The, 
inadequate learning of English may be partly due, in turn, to negative 
or ambivalent attitudes to the dominant white culture, which is pressing 
hard on the Indian cultural identity the child has only partially estab- 
lished— Lambert and Gardner (1961) clearly identified set or attitude 
toward the speakers of a language as relevant variables in the success of 
the learner. 

A reliable measurement system that will tell us where the student 
stands in English, what his general personality adjustment is, and how 
these relate to the more common measures of intelligence and scholastic 

1 

achievement could have great significance. First we would be able to 
identify students most likely not to fail in college because of a language 
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handicap, whatever their standard achievement test showed* The language 
competence level can either be used as a guide to the most appropriate 
course for the student to attempt, or to remedial measures that should 
be taken before or concurrently with college work* Less directly, the 

i 

knowledge we gain from the relationships that are established between 
language, intelligence, achievement and adjustment can guide us in planning 
more effective and hopefully less damaging language training for bilingual 
Indian students* 

Hypotheses 

Our theory of second-language learning suggests a major hypothesis 
of this study: there is a factor in the abilities of an English-as-a- 

second-language speaker which can be isolated as English language ability* 

In all pencil-and-paper tests, it is accepted that language skill 
is a major factor. Ihis is true for native speakers as well as non- 
native speakers, so that students from .Impoverished language backgrounds, 
or those who speak non-standard dialects, are handicapped on achievement 
tests and verbal intelligence tests. Nonverbal tests were created to 
circumvent this handicap in the measurement of intelligence* However, 
verbal abilities are in fact more relevant to the largely verbal learning 
we wish to measure and/or predict tha& are other abilities (Wessman 19^7 , 
p. 27 $. The TOEFL would, we hoped, separate Ehglish ability from a 
generalized M verbal ability 1 * factor. 

Our second hypothesis was that a low TOEFL score would occur with 
poor adjustment scores* The student who is unable to handle the language 
of instruction, trapped in a school situation, will suffer damage to his 
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feelings of self-worth and social adequacy. 

Two measures of intelligence, the Otis Gajmma verbal and the Chicago 
nonverbal, are included in the battery of tests to be correlated in this 
study, A third hypothesis, related to the importance of English language 
ability to test success, was that there would be a significant difference 
in the mean scores of the two types of intelligence tests. This finding - 
would corroborate many previous studies of language-handicapped learners. 
Verbal intelligence scores in the dull or dull-average range often go 
with average or above average non-verbal scores. 

The correlation between scores of male and female students were 
examined, assuming that males would surpass females, consonant with Indian 
cultural patterns ( Styles of Learning 1968, p. 5)* 

The correlations between scores of students at different grade levels 
were analyzed to determine if the expected growth from the ninth through 
thirteenth years of school actually occurred. 

In testing the hypotheses, where probability was an appropriate dimen- 

i, 

sion, a ,05 or ,01 level of significance was sought. 

Definitions 

Specific English language ability is defined in this paper as the 
score made by a student on the composite TOEFL, and on subtests of the 
TOEFL. 

Nonverbal intelligence is defined as the score made by a student on 
the Chicago Non-Verbal Examination, 

Verbal intelligence is the score made by a student on the Otis 

, t 

Quick-Scoring Mental Ability Test, Gamma. 
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Achievement is defined as the score made by a student on the 
composite of the Iowa Test of Educational Development and the subtests 
of this test. 

Adjustment is defined as the s^res made by students on the tests 
of the Bell Adjustment Inventory. 

Review of Literature 

The concept basic to a correlation study of this type is that 
finding significant correlations between different types of measurements 
will give us useful information about the bilingual Indian student* s 
personality and educational development. The literature was examined, 
therefore, in terms of two major elements# bilingualism and its effect 
on learning, and the findings of te>its that have been used with Ihdian 
and other bilinguals. 

flie most complete study of bilingua? ism was made by Uriel Weinreich 
(1953)* He reports a number of research studies proving a degree of 
personality handicap in the bilingual individual. A study by Dorothy 
Spoerl (1946) concluded that the high frequency of maladjustment among 
bilingual college freshmen of her sample had resulted from cultural con- 
flicts within their bilingual homes, ra thorn than from bilingualism. 
Richard Diebeld ( 1966 ) found that bilingualism may facilitate performance 
on both verbal and non-verbal intelligence tests. However, he also found 
that antagonistic acculturative pressures from a sociologically dominant 
monolingual society could create cases of bilingual psychopathology. 

Lambert and Macnamara ( 1969 ) were unable to find any support for 

their theory that bilingual experience enhances cognitive flexibility. 
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Thus, In general, the literature seems to suggest that although bilingual- 
ism is not necessarily a handicap to adjustment and achievement, cultural 
pressures may cause it to have a negative effect. 

Since Indian students are certainly a linguistic minority in a 
” sociologically dominant monolingual society” (to quote Diebold, 1966), 

t 

the literature lends support to our theory that their English language 
learning problems may have an adverse effect on both their general 
learning ability and their adjustment. 

Much has been written about intelligence testing, concluding that 
verbal tests, at least, cannot really be said to measure an innate ability 
apart from learning; and since the learning is verbal, it must depend to 
a large extent on the language involved. Indeed, the relevance of 
intelligence tests in education has recently been questioned in a global 
sense. Such tests seem to predict future school success or failure, but 
they do not indicate specific directions in which behavior might be 
altered in order to influence this outcome (Barritt 1967). Strong evidence 
that intelligence test scores change over time as a function of the inter- 
action between the student and his environment (Moriarty 1966) leads us 
to question the use of any single intelligence measure to stereotype the 
child. Intelligence tests do not suggest ways in which the child* s 
learning could be increased, but low scores indicate to the teacher that 
ha will not do well, and the role of teacher expectation in educational 
outcomes has been well documented. 

The literature on intelligence tests of American Indian children, 
dating as far back as 1928, shows a difference between verbal and non- 
verbal IQ scores* Jameson and Sandiford administered both types of tests 
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to 717 mixed-blood Indians in Southern Ontario and found a difference 
of 5 IQ points in favor of the nonverbal tests (Jameson and Sandiford 
1928, pp. 5?6-51). Later comparisons of the same kind showed that IQ 
on the nonverbal test was 10 to 14 points higher than on the verbal 
measure (Garth and Smith, pp, 376-81). In 1944, Sioux children wore 
given the Grace Arthur Point Perf ormance Scale, a battery of nonverbal 
tests, and the Kuhlmann-Anderson verbal test. The average IQ on the 
Kuhlmann-And or son was 82.5, and on the Arthur test 102.8. The correla- 
tion coefficient between the two sets of scores was .53 (Havighurst 
1957. pp. 105-14). 

More recently, the Chicago Non-Verbal examination was given to 700 
Indian students at Sherman Institute® The mean score was 95.1 (Paxton 
1965). Students of the same school later were given the WISC and WAIS 
tests, on which the Full Scale mean was 87.3# while the Performance 
Scale alone produced a mean of 97*1. 

Malco3.ra Garber (1968) using the Illinois Test of Psycholinguists 
Development, reports that Indian children rank well below even Spanish- 
American bilingual children on all measures of psycholinguists ability 
except visual-mo Sr tasks. 

The poor performance of Indian children on standardized tests is 
too well known to need further documentation. Coleman (19 66), Zintz (I963), 
Smith (1968), and Coombs (1958) all presented the sad picture of achieve- 
ment scores laggSg from two to eight years behind the national norms. 

A recent item analysis made for the California Achievement Tests of 
Indian students at Sherman Institute discovered major areas of learning 
deficit which could bo attributed to bilingualism and cultural difference 
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(Bates 1969). 

The concept that a test of specific English language ability may 
show Indian students to be more like foreign students than they are like 
middle-class white native- speakers is given support by a study made at 
the University of New Mexico in 1969. Native- speaking students who 
ranked below the 29th percentile on the American College Tests scored 
high and within a narrow range on the TOEFL (Table 10), showing that 
the test is inappropriately easy for native speakers ( Comparison . 1970, 
p. 24). 

Design of the Study 

The students in this study attended the Institute of American 
Indian Arts (IAIA) in Santa Fe, New Mexico. They were recruited from 
all over the United States, and are, we felt, reasonably representative 
of all types of Indian bilinguals. (See Table 1 for language families 
represented.) However, these students were not selected for academic 
excellence, but for artistic ability, and in this respect they are not 
representative of all students. Also, some relevant infonnation, such 
as the age at which each student first began English and the amount of 
English used in the home, could not be obtained. 



Table 1 



LANGUAGE FAMILIES 


BOYS 


GIRLS 


TOTAL 


Tanoan 


26 


» 

W\ 

CM 


51 


Uto-Aztekan 


11 


8 


19 


Keresan 


6 


7 


13 


Athabaskan (Apache) 


3 


8 


11 



o 
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(LANGUAGE FAMILIES) 
Algonkian 

Athabaskan (Navajo) 

Siouan 

Eskimo , Sahaptian, Iroquois 

Zuni 

Other 

Total 



(BOYS) (GIRLS) (TOTAL) 

5 7 12 

9 1 10 

5 2 7 

6 2 8 

13 4 

6 1 7 _ 

78 64 142 



LANGUAGES REPRESENTED WERE} 

Tanoan: Tiwa (6), Tewa (33) • Towa (11), Kiowa (1) 

Uto-Aztekan* Ute (7)» Pima-Papago (6), Shoshone (3)» Hopi (2), Comanche CO 
Keresan: (13) 

Athabaskan, Apache* (11) 

Algonkian: ELackfeet ( 3 )* Cheyenne (2), Ottawa (1), Passamaquoddy (1), 

Gros Ventre (2), Chippewa (2) 

Athabaskan, Navajo* (10) 

Siouan* Crow (1), Sioux (5)» Winnebago (1) 

Eskimo * ( 3) 

Zuni* (4) 

Sahaptian* Yakima (1), Nez Perce (2) 

Iroquois* Cherokee (2) 

Other* Chocktaw (1), Hualappi (1), U.S. (2), Spanish speaking (3) 



The diversity of language families represented made it difficult 
to draw any conclusions regarding language background influence on English 

skills. The sample of each language was too small in most cases to pro* 
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vide valid comparisons. In addition, the students from different 
language backgrounds also came from such diverse environments that it 
would be impossible to determine that language was the only or even the 
major cause of differences in scores. In the final analysis, 9 students 
had to be omitted because they had missed two or more tests. 

With the exception of the TOEFL, the Instruments used in this 
study were tests well known to educators, A brief description of each 
tests follows, 

1, The Otis Quick Scoring Mental Ability Test , Gamma . For grades 9-16, 
Revised in 1954 from an earlier Otis Higher Level test. More than two- 
thirds of the test measures some form of verbal competence. The test 
has proved reliable over many years of use as a reasonably good pre- 
dictor of school success (Lefever, 1941). 

2, Chicago Non-Verbal Examination . H ... designed specifically for those 
children who are handicapped in the use of the English language. ...those 
who come from homes where a foreign language is spoken, or from communi- 
ties or institutions where there is a meager use of the English language. ,., w 
(Brown 1940, p. 2). 

The Chicago Non-Verbal Examination correlated with the Otis Quick- 
Scoring Mental Ability Test, Gamma at .39 at the jf> level of significance, 
as measured by a sample of college juniors in a psychology class (Allen 
1950, p. 394). In another comparison, a correlation of ,67 was found 
between the Chicago Non-Verbal Examination and the Otis Intermediate, a 
version of the Otis Quick-Scoring Mental Ability Test designed for students 
from age eight through fifteen. 

Although the nonverbal test consists entirely of figures and pictures. 
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many of them must be manipulated in response to oral instructions. One 
reviewer said of the examination! M The instrument shows how difficult 



it is to devise tests which do not make use of verbal concepts in some 
form. Of the ten tests in the battery, only four appear entirely free 
of such concepts, while the remaining tests make wide demands on general 
information and knowledge of things associated with everyday life* 
(Pignatelli 19*f0, p, I387). 

3* Test of English as a Foreign Language , This is composed of five 
sections measuring various aspects of second-language skill: Listening 

Comprehension, English Structure, Vocabulary, Reading Comprehension, 
Writing Ability, and Composite. Part scores are useful for diagnostic 
interpretation, since they identify specific areas of strenght or weakness 
in overall performance ( Interpretive Information 1970, p, 4), The test 
had been administered to 113,975 students from February 1964 through 
June 1969. Norms are based on the performance of these students. 

The validity of TOSFL for predicting college success depends to a 
great extent upon special characteristics of the college involved. Each 



college presumably should set its own TOEFL norms. Data have been 

collected, however, which give a general range of TOEFL scores within 

which certain outcomes can be expected. Table 2 below reproduces these 
expectations. 



TOEFL SCORES 

550 and above 



Table^ 

POSSIBLE ACTION 

No restrictions. Students may be admitted to full-time 
study in any field. No English as a Second Language 
courses seem necessary. 
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(TOEFL SCORES) (POSSIBLE ACTION) 



450-549 



Students appear to need some English as a Second 
Language training. No restrictions in course load 



300-449 



seem necessary. 

Reduced study load; considerable English as a Second 
Language is needed— perhaps a two-semester sequence 
of H intensive” or M semi- in tensive . M 



200-299 



Student requires full-time intensive English as a 
Second Language instruction. He is not ready for 
subject-matter courses in a U.S. university. 



4, Iowa Test of Educational Development, An achievement test consisting 
of eight subtestss 1, Understanding of basic social concepts; 2, General 
background in the natural sciences; 3. Correctness and appropriateness 

of expression? 4* Ability to do quantitative thinking; 5* Ability to 
interpret reading materials in the social studies; 6, Ability to inter- 
pret reading materials in the natural sciences; 7, Ability to interpret 
literary materials; 8, General vocabulary; 9. A composite of scores 
1-8. The test is presented in written form and every part makes consider- 
able demands on English language ability, aside from content knowledge, 

5. Bell Adjustment Inventory Revised (1962) Student Form . This inventory 

includes six measures: 1. Home adjustment; 2, Health adjustment; 

3. Subraissiveness; 4, Emotionality; 5» Hostility; 6, Masculinity-femin- 
inity. On each test with the exception of 6, a high score indicates that 
a problem may exist in that field, while a l.ow score shows apparent satis- 
factory adjustment. On the M-F scale, a high score shows a preponderance 



of masculine interests. 
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Data Analysis 

Test scores were obtained in standard-score or IQ form. The data 
were run through two computer programs, one-way analysis of variance 
and factor analysis. 

We were mainly interested in the differences between boys and girls, 
grade levels, and language backgrounds. The significance of differences 
between the means were determined by analysis of variance. 

We examined our data in four sets, according to the tests the 
students had taken. Set One consisted of 78 students in grades 9-12* 

43 boys and girls. These students took five tests: Verbal IQ (VIQ), 

Non-Verbal IQ (NVIQ), TOEFL, ITED, And Bell Adjustment Inventory (Bell), 

Set Two was made up of 1 6 students, 5 boys and 11 girls, in grades 
9, 11. and 12. These students took the VIQ, NVIQ, TOEFL, and ITED. 

Set Three comprised 33 students, 2t boys and 12 girls, all in grade 
13. They took VIQ, NVIQ, TOEFL, And Bell. 

Set Four included all the other sets and six additional students, 

3 girls and 3 boys in grade 13 for a total of 133* This set examined 
only VIQ, NVIQ, and TOEFL scores. Table 3 shows the grade-sex division 
for all students. 



Table 

GRADE .. 

13 

12 

11 

10 

9 



MALE 


FEMALE 


TOTAL 


24 


15 


39 


20 


9 


29 


16 


17 


33 


7 


8 


15 


5 


12 


17 


72 


"IT 


133 




Total 
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Approximately half the students were at the grade level for which 
the TOEFL was intended— ready to enter college. 

IQ Comparisons 

Verbal and nonverbal IQ scores showed the expected difference- 
nonverbal means being consistently higher than verbal throughout the 
analysis. For all 133 students, the mean verbal IQ was 90.6 (sd, 9*8) 
and mean nonverbal IQ 107.7 (sd. 15.6). This difference is significant 
beyond the .001 level. The correlation coefficient between the two is 
.52, almost exactly that obtained in the 1944 Sioux study (Havighurst 
1957). 

Table 4 shows the differences in the two IQ measurements by language 
background. There are apparent language-background differences reflected, 
but the number in each tribal group is too small for these to be con- 
sidered significant. High scores, sometimes reaching the • bilevel of 
significance in the analysis of variance between scores on different tests, 
were frequently found among the Algonkian, Keresan, and Siouan groups. 
However, since there were only 8 Algonkian students, 12 Keresan and 6 
Siouan subjects whose tests scores could be considered, not too much 
importance can be attached to these scores. It is all too likely that 
these groups happened to include some of the most able students, regard- 
less of language. 

The IAIA mean on the NVIQ compared with the mean obtained at 
Sherman Institute in 1965 shows* 

Sherman Institute 95.01— sd. 16.8 (Paxton 1965) 
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IAIA 



107.7 — sd. 15.6 



